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APPARATUS AND METHOD FOR COMPRESSION-TRANSMITTING AND 
DECODING PICTURE INFORMATION AND STORAGE MEDIUM STORED ITS 

CONTROL PROGRAMS 



5 BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to an apparatus and a 
method for compression-transmitting picture information 
such as live picture information, a decoding apparatus for 

10 reducing compressed video data decoding processing load and 
decoding picture information, and a storage medium stored 
a control program for controlling the real time 
compression-transmission of picture information and 
decoding the picture information. 

15 Description of the Related Art 

To compress picture information such as live picture 
information in a real time manner compress ion and to transmit 
the picture information on a computer network, there are 
roughly two conventional methods, i.e., a direct 

20 transmission method and an FIFO (First-In-First-Out) 
method. 

In case of the direct transmission method, bit strings 
having different sizes according to frames outputted by a 
live encoder are outputted to a network as they are. In 
25 that case, even if the transmission bit rate of data 
transmitted for one second is constant, a momentary 
transmission bit rate greatly varies depending on properties 



such as encode modes and the motions of pictures. Due to 
this, burst data temporarily occupies a network band, with 
the result that packet collision and packet loss tend to 
occur and transmission efficiency thereby deteriorates . if 
5 there is little room for an empty band of the network relative 
to an average stream transmission band, in particular, the 
deterioration of transmission efficiency is more 
conspicuous . 

The direct transmission method will be described in 
10 more detail with reference to Fig. 25. A picture signal 
inputted from a camera 10 is encoded in frame units (e.g. , 
at intervals of about 1/30 seconds) by a real time encoder 
11 which encodes data in real-time, and written into a frame 
buffer 12. Next, frame data having difference sizes 
15 according to frames is outputted altogether to a network 
16 at the best efforts by a network transmission section 
15a, and fed to clients 171 to 17m connected to the network. 
In that case, the momentary transmission bit rate of the 
K-th frame (R no-control-K) is a gradient of a waveform W10 
20 shown in Fig. 26 and obtained from the following formula 
(1): 

R no-control-K = BK / TSK [bit /sec] > RS (1) 
Here, TSK: transmission time for transmitting K-th frame 
data to network, 

25 BK: quantity of the K-th frame data accumulated in 

frame buffer, and 

R no-control-K: network transmission bit rate for 
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K-the frame. 

Since this momentary transmission bit rate (R 
no-control-K) is far higher than an average bit stream rate 
(RS ) , chance of transmitting burst packet data is increased, 
5 resulting in the deterioration of transmission efficiency. 
In Fig. 2 6 , TFK is a frame distance between the K-th frame 
and the (K+l )th frame and TWK is a time for which the encoder 
11 writes the K-th frame data into the frame buffer 12. 
In case of the FIFO method, bit strings having different 
10 sizes according to frames outputted from the live encoder 
are sequentially written into an FIFO and stream data read 
from the FIFO at a constant speed using a process different 
from the encoder process is outputted to the network. The 
FIFO method will be described in more detail with reference 
15 to Fig. 27. A picture signal inputted from the camera 10 
is encoded in frame units (e.g. , at intervals of about 1/3 0 
seconds) by a real time encoder 11 and sequentially written 
into an FIFO 12a. Next, the data read from the FIFO 12a 
at a constant speed by a network transmission section 15a 
20 is outputted to a network 16 at a constant rate and fed to 
clients 17i to 17 m connected to the network. A momentary 
transmission bit rate (RFIFO) in that case is a gradient 
of a waveform Wll shown in Fig. 28 and equal to an average 
stream bit rate (RS) as shown in a formula (2) below: 
25 RFIFO = RS [bit /sec] (2) 

Here, RS : average stream bit rate; and 

RFIFO: transmission bit rate for transmission to 
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network. 

Due to this, it is possible to avoid the burst 
transmission of packets and to transmit data efficiently. 
However, if the above-described picture information 
5 transmission means is used, an FIFO requiring overflow and 
underflow control is necessary and it is also necessary to 
start another process for network output, thereby 
disadvantageously complicating packaging compared with the 
direct transmission method. 

10 Next, a conventional decoding apparatus for decoding 

a compressed video data is shown in Fig. 29. In Fig. 29, 
compressed video data is inputted into a variable length 
decoder 51 and subjected to variable length decoding. 
Decoded quantization coefficients a, i.e., quantization 

15 discrete cosine transform coefficients are inputted into 
an inverse quantizer 52, and decoded motion vector 
information b is inputted into a motion compensation 
predictor 57. The quantization coefficients a are 
dequantized by the inverse quantizer 52 and discrete cosine 

20 transform coefficients F(u, v) are inputted into an inverse 
discrete cosine transformer 60. The motion compensation 
predictor 57 extracts predictive picture data for using 
prediction from the pictures stored in a frame memory 58 
using the motion vector information b. 

25 Encode mode information c decoded by the variable length 

decoder 51 controls switching means 59. If the encode mode 
is an intra-plane encode mode, the switching means 59 is 
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turned off and nothing is added to outputs f (x, y) from the 
inverse discrete cosine transformer 60 by an adder 56. 
Therefore, the outputs are outputted as decoded picture 
outputs r(x, y) as they are and also stored in the frame 
memory 5 8 . 

On the other hand, if the encode mode is a mode other 
than the intra-plane encode mode, the switching means 59 
is turned on, the outputs f (x, y) from the inverse discrete 
cosine transformer 60 are added to motion compensation 
predictive pictures c(x, y) by the adder 5 6 and the outputs 
are outputted as decoded picture outputs r(x, y) and also 
stored in the frame memory 58. 

In a compressed video data decoding processing, inverse 
discrete cosine transform has the largest processing load. 
Due to this, such a high-speed inverse discrete cosine 
transform algorithm as described in B. G. Lee, "A new 
algorithm to compute the discrete cosine transform", IEEE 
Trans . Acoust . , Speech, and Signal Processing, vol . ASSP-32 , 
pp. 1243-1245, Dec. 1984 is employed. 

If a higher processing is required, a method of reducing 
a decoding processing by thinning out the number of decoded 
picture planes is employed. For example, a method in which 
only pictures which have been subjected to intra-plane 
encoding (intra encoding) are decoded and pictures encoded 
in modes other than the intra-plane encode mode are not 
decoded, is employed. 

However, if a decoding processing is conducted by a 



software using, for example, a personal computer and the 
processing performance of the personal computer is low, even 
such a high processing is insufficient, thereby 
disacivantageously causing a disadvantage that the number 
5 of played back pictures planes greatly decreases. 

SUMMARY OF THE INVENTION 
It is an object of the present invention to provide 
a real-time picture information compression-transmission 
10 apparatus , a method thereof as well as a storage medium stored 
a control program for real-time picture information 
compression control capable of efficiently transmitting 
picture information in a real time manner without employing 
FIFO requiring overflow and underflow control, without 
15 starting a process exclusive to network output while 
suppressing the generation of packet loss to be low. 

It is another object of the present invention to provide 
an compressed video data decoding apparatus capable of 
ensuring a higher processing speed than a conventional 
20 processing speed. It is yet another object of the present 
invention to provide a compressed video data decoding 
apparatus capable of greatly reducing compressed video data 
decoding load without causing so great deterioration in 
picture quality and decrease in the number of played back 
25 picture planes when playing back a picture. 

The present invention has the following 
characteristics: the present invention comprises input 
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means for receiving said picture information; an encoder 
encoding said picture information from the input means on 
a preset cycle in a real time manner; storage means for writing 
and storing real-time-encoded frame data on said picture 
information from the encoder for each frame; division means 
for sequentially dividing said real-time-encoded frame data 
stored in the storage means into packets for each frame; 
and transmission timing control and transmission means for 
controlling transmission timing to sequentially transmit 
the divided packets to a network after a write time for storing 
said frame data for the packets and before a time for storing 
next frame data, and for transmitting the packets to the 
network according to a connection-less type protocol. 

Further, the present invention can be constituted to 
include a packet transmission timing adjustment section, 
a packet loss detection section and transmission timing fine 
adjustment parameter generation section, and a packet loss 
detection and bit rate feedback section. A transmission 
packet division section divides bit string data in a frame 
buffer in which frame data output from a real time encoder 
encoding picture information to frame data in a real time 
manner is written and stored for each frame, into packets 
of packet size suited for an MTU (Maximum Transmission Unit: 
Ethernet maximum transfer unit) . The packet transmission 
timing adjustment section adjusts transmission timing for 
transmitting the packets divided by the transmission packet 
division section, i.e., adjusts transmission timing so as 



to transmit the packets after a write time for storing the 
frame data and before a time for storing the next frame data, 
thereby outputting the packets to the network while 
suppressing burst transmission of packets. A network 
5 output processing is conducted in an encoder processing loop 
without starting an exclusive process. The packet loss 
detection and transmission timing fine adjustment parameter 
generation section monitors the packets of each channel 
outputted to the network, and conducts feedback control for 

10 issuing a timing fine adjustment command to the packet 
transmission timing adjustment section if packet loss occurs . 
The packet loss detection and bit rate feedback section 
monitors the packets of each channel outputted to the network , 
and conducts feedback control by requesting the real time 

15 encoder to decrease bit rate if packet loss occurs. 

The present invention comprises means for converting 
an inversely-quantized discrete cosine transform 
coefficient into a smaller base than an encoding-side 
discrete cosine transform base; means for performing inverse 

20 transform using inverse discrete cosine transform using the 
smaller base than the encoding-side discrete cosine 
transform base; and means for converting picture data 
subjected to the inverse discrete cosine transform into 
picture data having a same size as a size of a compressed 

25 video data. 

The present invention also comprises means for low-pass 
filtering an inversely quantized discrete cosine transform 
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coefficient; and means for inversely transforming the 
low-pass filtered data using an inverse discrete cosine 
transform having a base of a same size as a size of an 
encoding-side discrete cosine transform base, wherein the 
5 inverse discrete cosine transform is to inversely transform 
a non-zero discrete cosine transform coefficient. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a transmission control block diagram in the 
10 first embodiment according to the present invention; 

Fig. 2 is a signal frame view for explaining the division 
of frame data into UDP packets in the first embodiment 
according to the present invention; 

Fig. 3 is a time chart for describing a frame buffer 
15 storage concept in the first embodiment according to the 
present invention; 

Fig. 4 is a flow chart showing the operation of a 
transmission control section in the first embodiment 
according to the present invention; 
20 Fig. 5 is a block diagram for describing filtering in 

the second embodiment according to the present invention; 

Fig. 6 is a block diagram for describing bit rate 
feedback control in the third embodiment according to the 
pres ent invent ion ; 
25 Fig. 7 is a block diagram for describing a serial number 

adding operation in the third embodiment according to the 
present invention; 
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Fig. 8 is a block diagram for describing fine adjustment 
feedback control over transmission timing for a plurality 
of channels in the fourth embodiment according to the present 
invention; 

Fig. 9 is a flow chart for describing the operation 
of a transmission control section in the fourth embodiment 
according to the present invention; 

Fig. 10 is a flow chart for describing the operation 
of a packet loss detection and transmission timing fine 
adjustment parameter generation section in the fourth 
embodiment according to the present invention; 

Fig. 11 is a time chart for describing packet 
transmission timing fine adjustment parameters S J ( 1 ^ J 
S N , where N is total channel number ) in the fourth embodiment 
according to the present invention; 

Fig. 12 is a block diagram showing a constitution of 
computer performing of the first to twelfth embodiment 
according to the present invention; 

Fig. 13 is a block diagram showing the constitution 
of the fifth embodiment according to the present invention; 

Fig. 14 is a block diagram showing the constitution 
of the sixth embodiment according to the present invention; 

Fig. 15 is an explanatory view showing one example of 
high-speed inverse discrete cosine transform using 
butterfly operation; 

Fig. 16 is an explanatory view for the butterfly 
operation applied to the sixth embodiment according to the 
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present invention ; 

Fig. 17 is a block diagram showing the constitution 
of the seventh embodiment according to the present invention ; 

Fig. 18 is a block diagram showing the constitution 
5 of the eighth embodiment according to the present invention; 

Fig. 19 is a block diagram showing the constitution 
of the ninth embodiment according to the present invention; 

Fig. 2 0 is a block diagram showing the constitution 
of the tenth embodiment according to the present invention; 
10 Fig. 21 is a block diagram showing the constitution 

of the eleventh embodiment according to the present 
invention; 

Fig. 22 is a block diagram showing the constitution 
of the twelfth embodiment according to the present invention; 
15 Fig. 23 shows mathematical formulas; 

Fig. 24 shows the outline of a program stored on a storage 
medium; 

Fig. 25 is a block diagram showing an example of a 
conventional transmission apparatus based on a direct 
20 transmission method; 

Fig. 26 is a time chart for describing a frame buffer 
storage concept in the conventional transmission apparatus 
based on the direct transmission method; 

Fig. 27 is a block diagram showing an example of a 
25 conventional transmission apparatus based on an FIFO method; 

Fig. 2 8 is a time chart for describing a frame buffer 
storage concept in the conventional transmission apparatus 
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based on the FIFO method; and 

Fig. 2 9 is a block diagram showing the constitution 
of a conventional decoding apparatus . 

5 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention will be described in detail with 
reference to the accompanying drawings. 

Description will be given, as the first embodiment, 
to a method of efficiently transmitting live picture 

10 information by transmission control while applying a 
connection-less type protocol, e.g., UDP (User Datagram 
Protocol ) to a transport protocol . Fig . 1 is a block diagram 
for describing the interior of a transmission control section 
15 in case of efficiently transmitting live picture 

15 information by transmission control. A picture signal 
inputted from a camera 10 is encoded in frame units (e.g. , 
at intervals of about 1/30 seconds) by a real time encoder 
11 which encodes data in a real time manner, and written 
into a frame buffer 12. Next, frame data having different 

20 sizes according to frames is fed to a transmission packet 
division section 13. In consideration of transmission 
efficiency and packet transmission on a network which does 
not permit IP (Internet Protocol) fragmentation, the 
transmission packet division section 13 divides the frame 

25 data into packets of UDP payload size which can prevent the 
occurrence IP fragmentation and can make overhead by each 
of headers for the Ethernet, the IP and UDP the smallest. 
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Specif ically, as shown in Fig. 2, the frame data is divided 
into packets of such size as to be suited for the Ethernet 
maximum transfer unit (MTU). To calculate a UDP pay load 
size (UDP_PSIZE), the following formula (3) is used: 
5 UDP_PSIZE = MTU_SIZE - IP_HEADER_SIZE 

UDP_HEADER_S I Z E ( 3 ) 

Here/ UDP_PSIZE : payload size of UDP packet to be 
transmitted (unit: byte), 

MTU_SIZE: Ethernet maximum transfer unit (usually 
10 1500 bytes) , 

IP_HEADER_SIZE: IP header size (20 bytes if no 
option is added), and 

UDP_HEADER_SIZE: UDP header size ( usually 8 bytes ) . 
Also, the number (CK) of UDP packets divided from the 
15 K-th frame data (BK bytes) is calculated by the following 
formula (4). In the formula (4), it is assumed to reckon 
decimals as a unit. 

CK = BK / UDP_PSIZE (4) 
Here, CK: number of UDP packets divided from K-th frame, 
20 BK: data size of K-th frame (unit: byte), 

UDP_PSIZE: payload size of UDP packet to be 
transmitted (unit: byte). 

The packet transmission timing adjustment section 14 
will be described, referring again to Fig. 1 . The K-th frame 
25 data which has been divided into CK packets by the 
transmission packet division section 13 is transmitted to 
the network 16 by the packet transmission timing adjustment 
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section 14 by the time the real time encoder 11 outputs the 
(K + 1 )th frame data to the frame buffer 12 , and fed to receiver 
clients 171 to 17m. 

The transmission timing of each of the CK UDP packets 
5 will be described with reference to Fig. 3. Assuming that 
a frame distance between the K-th frame and the (K + l)th 
frame is TFK and time for which the real time encoder writes 
the K-th frame data into the frame buffer is TWK, time TSK 
for which the K-th frame data can be transmitted to the network 
10 is as shown in the following formula (5): 
TSK = TFK - TWK (5) 
Here, TSK: transmission time [sec] for transmitting K-th 
frame data to network, 

TFK: frame distance [sec] between K-th frame and 
15 (K + l)th frame, and 

TWK: time [sec ] for which encoder writes K-th frame 
data into frame buffer. 

According to the present invention, the CK UDP packets 
are transmitted for time TSK while arranging the packets 
20 equidistantly . In that case, the transmission bit rate (R 
control-K) of the K-th frame is a gradient of a waveform 
W12 shown in Fig. 3 and calculated from a formula (6). 
Compared with the conventional direct transmission method, 
the transmission bit rate of each frame is close to the average 
25 stream bit rate as shown in a formula ( 7 ) , so that burst 
transmission can be avoided. 

R control-K = BK / TSk [bit /sec] (6) 
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R no-control-K > Bcotrol-K > Rs (7) 
Here, BK: quantity of K-th frame data accumulated in frame 
buffer, 

R control-K: transmission bit rate for transmitting 
5 K-th frame to network according to the present invention , 
R no-control-K: transmission bit rate for 
transmitting K-th frame to network according to direct 
transmission method shown in Fig. 14, and 
RS: average stream bit rate. 

10 The operation of the packet transmission timing 

adjustment section 14 shown in Fig. 1 will be described in 
detail with reference to the transmission control section 
flow chart of Fig. 4. First, an initial value 1 is 
substituted for the frame number K in a step S10. The K-th 

15 frame data inputted in a step Sll is divided into CK pieces 
of data calculated from the formula (4) in a step S12. The 
divided data are defined as (Dl, D2, D3 , , DCK) f 
respectively. Next, in a step S14, a UDP packet with the 
leading data Dl thus divided used as a payload is transmitted . 

20 At this moment, transmission time is substituted for packet 
transmission start time TR in a step S13. Next, it is 
determined whether or not the difference between the present 
time TN substituted in a step S15 and the packet transmission 
start time TR becomes not less than TSK/CK based on a 

25 determination formula (formula (8)) in a step SI 6. If a 
determination result is NO, time does not reach packet 
transmission timing and the steps S15 and SI 6 are repeated. 
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If the determination result is YES, time reaches the 
transmission timing and a step S17 follows. If there is 
divided data which has not been transmitted yet in the frame, 
the next data (D2 in this case) is transmitted in packets. 
5 This operation is repeated up to the data DCK. When there 
is no divided data which has not been transmitted in a step 
SI 7 , the numbers of frames waiting to be received are incresed 
by "1" in a step S18 and the processing is moved to waiting 
for the reception of the next frame data (the step Sll). 
10 TN - TR ^ TSK / CK [sec] ••• (8) 

Here, TN: present time, 

TR: packet transmission start time, 

CK: number of UDP packets divided from K-th frame, 

and 

15 TSK: transmission time [sec] for which K-th frame 

data is transmitted to network. 

As described above, according to the first embodiment, 
the transmission control section 15 does not transmit data 
to the network for a time for which the real time encoder 

20 11 writes the data into the frame buffer 12. Due to this, 
it is possible to incorporate a network output processing 
into the processing loop of the real time encoder 11. As 
a result, compared with the conventional method in which 
FIFO is used and another process for network output is started, 

25 it is possible to realize a network output processing with 
simple packaging. Furthermore, by extending the 
transmission time for transmitting frame data to the network 
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to a time at which the next frame is written into the buffer, 
it is possible to avoid burst transmission of frame data 
packets to the network compared with the conventional direct 
transmission method and to thereby suppress the generation 
5 of packet loss and to improve transmission efficiency. 

Next, description will be given, as the second 
embodiment , to a method capable of transmitting only filtered 
picture information by filtering transmission packets using 
UDP port numbers or IP multi cast addresses even if a network 

10 band in the course of transmission becomes narrower, with 
reference to Fig. 5. Since a transmission method for each 
channel is the same, J channel (1 ^ J ^ N, where N is the 
number of channels ) representing channels will be described . 
As in the case of the first embodiment, picture information 

15 outputted from a camera 10 J is real-time encoded by a real 
time encoder 11 J and written into a frame buffer 12 J. Frame 
data written in frame units (e.g., at intervals of about 
1/3 0 seconds) is divided to be suited for MTU size by a 
transmission packet division section 13J and the divided 

20 transmission packets are sequentially transmitted to a 
network 1 6 by a packet transmission timing adjustment section 
14J while avoiding burst transmission. 

All the data transmitted for the respective channels 
are usually fed to receiver clients 171 to 17m through the 

25 network 16. However, if the band of a network 19 after a 
router (such as a remote access) 18 becomes narrower to make 
it impossible for all the data on 1 to N channels to pass 



through the band, then packet loss occurs to all channel 
data and no channel cannot be received by a reception client 
20. To avoid such a potential disadvantage , individual port 
numbers are allotted to channel packets and the router (e.g., 
5 remote access) 18 makes filtering setting to pass through 
only a packet having a port number (in this case, the port 
number of the J channel ( 1 ^ J ^ N, where N is the number 
of channels) ) wanted to be passed through the network band 
after the router (e.g., remote access) 18. By doing so, 

10 the receiver client 20 can normally receive designated 
channel data. 

Instead of allotting the different port numbers to the 
channels, respectively, IP multi-cast addresses may be 
allotted to the respective channels. By doing so, only the 

15 channel data corresponding to the IP multi-cast address for 
which the reception client 20 issues a reception request 
(by an IGMP protocol Join message), can be passed through 
the router (e.g. , remote access) 18 and the receiver client 
2 0 can, therefore, normally receive designated channel data. 

20 As stated above, according to the second embodiment, 

not only multi-channel transmission but also filtering is 
conducted using either the UDP port numbers or the IP 
multi-cast addresses, whereby it is possible to transmit 
only the filtered picture information even if the network 

25 band through which the data is transmitted is narrowed. 

Next, description will be given to, as the third 
embodiment , a case of adding a packet loss detection function 
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and a bit rate feedback function , with reference to Fig. 
6 showing bit rate feedback. As in the case of the first 
embodiment, a picture signal inputted from a camera 10 is 
encoded by a real time encoder 11 in frame units (e.g., at 
5 intervals of about 1/3 0 seconds) and written into a frame 
buffer 12 . Next, each frame data read from the frame buffer 
12 is divided into packets in CHUNK_SIZE shown in a formula 
(9) by a transmission packet division section 13 and serial 
numbers are added to the respective packets . A packet 

10 transmission timing adjustment section 14 transmits the 
packets to a network 16 while adjusting transmission timing. 
The transmitted data are received by receiver clients 171 
to 17m through the network 16. 

Here, the addition of serial numbers will be described 

15 with reference to Fig. 7 which shows a serial number addition 
function. A field for adding serial numbers 3 0 is provided 
in a UDP payload 31 and values incresed by 1 from serial 
numbers for the respective packets are stored in the field. 
A field 32 in which divided frame data are stored decreases 

20 by an area of the serial numbers (to be referred to as 
"SERIALJSIZE" ) . The size (CHUNK_SIZE ) into which the frame 
data 33 is divided is expressed as shown in a formula (9) 
below while using UDP_PSIZE in the formula (3): 
CHUNKJSIZE = UDP_PSIZE - SERIAL_SIZE (9) 

25 Here, UDP_PSIZE: payload size of UDP packet to be 
transmitted (unit: byte), 

SERIAL_SIZE: size storing serial numbers (unit: 
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byte), and 

CHUNK_SIZE: size into which the frame data is 
divided ( unit : byte ) • 

In addition , the number (CK) of UDP packets divided 
5 from the K-th frame data ( BK bytes ) is calculated by a formula 

(10) . In the formula (10) , it is assumed to reckon decimals 
as a unit. 

CK = BK / CHUNKJSIZE (10) 
Here, CK: number of UDP packets divided from K-th frame, 
10 BK: data size of K-th frame (unit: byte), and 

CHUNK_SIZE: size into which the frame data is divided 
(unit: byte) . 

In Fig. 6, the packets transmitted to the network 16 
are constantly monitored by a packet loss detection and bit 
15 rate feedback section 21 in the transmission-side same 
segment and a packet loss rate PLR is calculated by a formula 

(11) : 

PLR = PLN / PN (11) 
Here, PLR: packet loss rate, 
20 PLN: the number of packets lost for T seconds, 

PN: total number of packets transmitted for T seconds , 

and 

T: time interval for measuring packet loss rate (unit: 
second) . 

25 The packet loss detection is conducted by watching 

whether the serial numbers (incresed by one for the 
respective packets) added to the packets which have been 



2 0 - 



sequentially monitored are arranged in order . If the serial 
numbers skip, it is recognized that packet loss occurs. 

If the packet loss rate PLR exceeds a preset value L 
THB ( 0 S L THB ^ 1 ) , it is judged that a present transmission 
5 bit rate exceeds a transmittable network band level and a 
bit rate change request signal 22 requesting to decrease 
bit rate is transmitted to the real time encoder 11. The 
real time encoder 11 which has received the bit rate change 
request signal 22, changes the encoding bit rate to W-times 
10 (0 < W ^ 1) of the present rate. By repeating the 
above-stated operations, data can be transmitted with the 
packet loss rate PLR of not more than the preset value L 

THB. 

According to the third embodiment described above, by 
15 adding the packet loss detection and bit rate feedback 
functions and controlling the transmission bit rate in 
accordance with a network band, it is possible to avoid packet 
loss and ensure efficient transmission even if the network 
band is insufficient or the network band varies. 
20 Next, description will be given, as the fourth 

embodiment, to a case of adding a packet loss detection 
function and a bit rate feedback function when transmitting 
multi-channel live pictures, with reference to Fig. 8 showing 
transmission timing fine adjustment feedback. Since each 
25 channel operates in the same manner , a method of transmitting 
J channel (1 S J S N, where N is the number of channels) 
will be described to represent the channels . As in the case 
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of the third embodiment, a picture signal inputted from a 
camera 10 J is encoded in frame units (e.g., at intervals 
of about 1/30 seconds) by a real time encoder 11 J and written 
into a frame buffer 12 J. Next, frame data read from the 
5 frame buffer 12 J is divided into packet of frame data division 
size (CHUNK_SIZE) as expressed by a formula (9) by an 
transmission packet division section 13J, serial numbers 
are added to the divided packets and the divided data are 
transmitted to a network 16 while a packet transmission 

10 timing adjustment section 14J is adjusting transmission 
timing. The transmitted data are received by receiver 
clients (171 to 17m) through the network 16. 

The packet loss rate PLRJ ( 1 S J ^ N, where N is total 
channel number) of each channel of the packet transmitted 

15 to the network 16, which is constantly monitored by a packet 
loss detection and transmission timing fine adjustment 
parameter generation section 23, is calculated by a formula 
(12): 

PLRJ = PLNJ / PNJ (12) 
20 Here, PLRJ: packet loss rate of J channel data, 

PLNJ: the number of packets lost for T seconds with 
respect to J channel data, 

PNJ: total number of packets transmitted for T 
seconds with respect to J channel data, and 
25 T: time interval for measuring packet loss rate 

( unit : second ) . 

The packet loss detection and timing fine adjustment 
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parameter generation section 23 determines packet 
transmission fine adjustment parameters SJ so that the sum 
of the packet loss rates PLRJ of the channels becomes a minimum 
while sequentially changing packet transmission fine 
5 adjustment parameters SJ (SI, S2, SN, where N is total 
channel number, 1 ^ J ^ N) fed back to the packet 
transmission timing adjustment section 14 J according to the 
frame reception timing. The detail of changing SJ will be 
described later. This packet transmission fine adjustment 

10 parameters S J are passed on to the packet transmission timing 
adjustment section 14 J through a common memory 25 and used 
when fine-adjusting transmission timing. 

The operation of the packet transmission timing 
adjustment section 14 J will be described with reference to 

15 the flow chart of Fig. 9. First, an initial value 1 is 
substituted for frame number K in a step S2 0 . The K-th frame 
data inputted in a step S21 is divided into CK pieces of 
data calculated from a formula (10) in a step S22. The 
divided data are defined as (Dl, D2, D3, — , DCK), 

20 respectively. Next, in a step S23, timing fine adjustment 
parameters S J ( 1 ^ J ^ N, where N is the number of channels ) 
for the J channel are read from the common memory. If a 
determination result in a step S24 shows that SJ is 0, a 
step S2 6 follows. If SJ is a value other than 0, a time 

25 weight of transmission delay SEND DELAYJ calculated by a 
formula (13) is added to thereby delay the transmission 
timing of J channel packets in a step S25 and the step S26 



-23- 



follows . 

SEND_DELAYJ = MTU_SIZE * S J* 8 /BR_NET ••• (13) 
Here, SEND_DELAYJ: J channel packet transmission delay 
(unit: second), 

5 MTU_SIZE: Ethernet maximum transfer unit, usually 

1500 bytes, 

SJ: J channel timing fine ad jus tment parameters (SJ, 
1 S J ^ N, where N is the number of channels), and 

BR__NET: effective network band (unit: bit/sec) . 

10 Next, a UDP packet with a leading data Dl divided used 

as a pay load is transmitted in a step S2 7. At this moment, 
transmission time is substituted for packet transmission 
start time TR in the step S2 6 . Next , it is determined whether 
the difference between the present time TN substituted in 

15 a step S28 and TR is not more than TSK / CK using the 
determination formula (formula 8) in a step S29. If a 
determination result is NO , time does not pass to reach packet 
transmission timing and the steps S28 andS29 are, therefore, 
repeated. If the determination result is YES, time already 

20 passes to reach the packet transmission timing and a step 
S3 0 follows. In the step S3 0, if there is divided data of 
the frame which has not been transmitted yet, the next data 
(D2 in this case) is transmitted in packets. These 
operations are repeated up to the data DCK. When no divided 

25 data which has not been transmitted is left in the step S30, 
the frame number K waiting to be received is incresed by 
1 in a step S31, moving to a step of waiting for the reception 
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of the next frame data (in the step S21). 

Next, a method of generating timing fine adjustment 
parameters SJ (SI, S2 , S3, , SN, where N is total channel 
number, 1 ^ J ^ N) will be described with reference to the 
5 flow chart of Fig, 10. First, inastepS40, default values 

0 are substituted for all timing fine adjustment parameters 
SJ (SI, S2, S3, •", SN, where N is total channel number, 

1 ^ j N). Next, in a step S41, a packet loss rate PLRJ 
(see the formula (12)) is calculated for each channel* In 

10 a step S42 , it is determined whether or not the sum of packet 
loss rates of all the channels is equal to 0. If the sum 
is equal to 0, the steps S41 and S42 are repeated. If not 
equal to 0, a step S43 follows. In the step S43, the latest 
frame number (RCFN) of reference channel data received as 

15 an initial value is substituted for the frame number K of 
a reference channel corresponding to frame timing at which 
the next packet loss rate is to be measured. The channel 
having the lowest frame rate (frames/sec) among the 1 to 
N channels is selected as the reference channel. In a step 

20 S44, all combinations of the timing fine adjustment 
parameters SJ (SI, S2, S3, , SN, where N is total channel 
number, 1 S J S N) are changed one by one in a range of 
0 ^ SJ < M, to thereby form a processing loop for executing 
steps S44, S45, S46, S47, S48 and S49. Here, M represents 

25 an upper limit of the packet transmission timing fine 
adjustment parameter SJ (SI, S2, S3, SN, where N is total 
channel number, 1 ^ J ^ N), and is deduced from a formula 
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( 14 ) while decimals are discarded to provide an integer not 
lower than 0. The packet transmission timing fine 
adjustment parameter SJ indicate by how many packets the 
packet transmission timing is delayed. Fig. 11 showing the 
5 packet transmission timing fine adjustment parameters SJ 
(1 S J ^ N, where N is total channel number) indicates that 
transmission timing of a packet transmitted at a time P10 
(while SJ is 0) is delayed up to a time Pll (where SJ is 
M-l) . 

10 M = (CHUNK_SIZE*8/(BR_STREAM_TOTAL/N) / (MTU_SIZE 

*8/BR_NET) (14) 

Here, M: upper limit of packet transmission timing fine 
adjustment parameter S J (SI, S2, S3, SN, where N is total 
channel number, 1 ^ J S N), 
15 CHUNK_SIZE: sizes into which frame data is divided 

(unit: byte) , 

BR_STREAM_TOTAL : total bit rate of 1 to N channels, 
N: number of channels, 

MTU_SIZE: Ethernet maximum transfer unit, usually 
20 1500 bytes, 

BR__NET: execute bit rate of network 
(BR_STREAM_TOTAL/N) : average bit rate per channel, 
(CHUNK_SIZE*8/ (BR_STREAM_TOTAL/N) : average packet 
transmission interval per channel (unit: second), and 
25 (MTU_SIZE*8/BR_NET) : time required to transmit MTU . 

A weight continues to be given until the latest frame 
number (RCFN) of the received reference channel data becomes 
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not less than K in the step S45 of Fig. 10. When the number 
becomes not less than K, the value of K is incresed by 1 
in the step S46. This indicates that the loop processing 
of the steps S44 to S49 is performed once for each frame 
5 of the reference channel. The loop processing of the steps 
S44 to S49 is completed at a timing when the sum of packet 
loss rates of all channels calculated in the step S4 8 using 
the packet loss rate PLRJ ( 1 S J ^ N, where N is total channel 
number) for each channel calculated in the step S47 becomes 

10 equal to 0, or when the loop processing is executed for all 
combinations in the step S49 . The parameters SJ are changed 
in the order of (SI, S2 , S3, — , SN) = (0, 0, — , 0) -> (1, 
0, 0) -> (1, 1, 0) -> (1, 1, 1) -> (2, 1, — , 

1) -> (2, 2, — , 1) -> (2, 2, — , 2) -> (M-l, M-2, — , M-2) 

15 -> (M-l, M-l, M-l), thereby executing M N combinations. 
If the loop processing is completed in the step S48, the 
timing fine adjustment parameters SJ (SI, S2, S3, SN, 
where N is all channel number, 1 ^ J ^ N) at that time are 
written into the common memory from which the parameters 

20 can be read out by the packet transmission timing adjustment 
sections for the respective channels in a step S51, and the 
processing returns to the step S41. If the loop processing 
is completed in the step S49, timing fine adjustment 
parameters SJ (Si, S2, S3, SN, where N is total channel 

25 number, 1 ^ J ^ N) which make the sum of packet loss rates 
of the respective channels a minimum are written into the 
common memory in the step S50, and the processing returns 
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to the step S41. 

As stated so far, according to the fourth embodiment, 
if the packet loss detection and the packet transmission 
timing fine adjustment are conducted for each channel when 
5 transmitting a multi-channel live picture, it is possible 
to suppress the generation of packet loss and to improve 
transmission efficiency at the time of transmitting 
multi-channel live picture information. 

While the first to fourth embodiments of the present 

10 invention have been described so far in detail with reference 
to the drawings, it is obvious that specific examples of 
constitution should not be limited to these first to fourth 
embodiments and that any changes in design within the range 
of the scope of the invention are contained in the range 

15 of the technical concept of the present invention. 

In case of the above-described first to fourth 
embodiments, for example, a transmission control program 
is recorded on a computer readable storage medium 200 shown 
in Fig. 12 and the transmission control program recorded 

20 on the storage medium 200 are read by a computer 100 shown 
in Fig. 12 to allow executing desired transmission control . 
Here, the transmission control program is control procedures 
for executing the functions of the transmission control 
section 15 shown in Figs. 1, 5, 6 and 8. 

25 The computer 100 shown in Fig. 12 consists of a CPU 

101 executing the above-stated transmission control program, 
an input device 102 such as a keyboard or a mouse, an ROM 
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(Read-only Memory) 103 recording various data, an RAM 
(Random- Access Memory) 104 recording operation parameters 
and the like, a reader 105 reading transmission program from 
the storage medium 2 00, an output device 106 such as a display 
5 or a printer , and a bus BUS connecting the respective elements 
of the apparatus. 

The CPU 101 reads the transmission control program 
recorded on the storage medium 200 through the reader 105 
and then executes the transmission control program, thereby 

10 making it possible to conduct the above-described 
transmission control program. 

Here, thestoragemedium200 involves not only recording 
mediums of various portable types such as an optical disk, 
a floppy disk, a hard disk and the like, but also recording 

15 mediums temporarily storing and holding data in a 
transmission medium such as a network. 

In a transmission simulation experiment while using 
ITU-TH. 263-base live picture information, if picture 
information of 512Kbps was transmitted with a network use 

20 rate of 60% on a 10Mbps, 10 Base-T LAN, the packet loss rate 
of the method and apparatus according to the present 
invention was reduced to 0.0% from the packet loss rate of 
the conventional method of 0.20%. If picture information 
of 100Kbps was transmitted on the same conditions , the packet 

25 loss of the method and apparatus according to the present 
invention was reduced to 0.0% from the packet loss rate of 
the conventional method of 0.32%. If picture information 
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of 512Kbps was transmitted with a network use rate of 70%, 
the packet loss rate of the method and apparatus according 
to the present invention was 0.28% compared with that of 
the conventional method of 0.68%. If picture information 
5 of 100Kbps was transmitted on the same conditions , the packet 
loss of the method and apparatus according to the present 
invention was reduced to 0.03% from the packet loss rate 
of the conventional method of 0.19%. 

Next, the fifth embodiment of the present invention 

10 will be described with reference to the block diagram of 
Fig. 13. It is noted that Fig. 13 shows one example of the 
internal constitution of the receiver client shown in Fig. 
1. The same reference symbols as those in Fig. 29 denote 
the same or equivalent constituent elements. In this 

15 embodiment, data is subjected to inverse discrete cosine 
transform at a decoding side while using a smaller base than 
that of the discrete cosine transform at an encoding side. 

Compressed video data is inputted into a variable length 
decoder 51. The variable length decoder 51 decodes 

20 quantization discrete cosine transform coefficients a, 
motion vector information b, encode mode information c and 
the like. The quantization discrete cosine transform 
coefficients a thus decoded are inputted into an inverse 
quantizer 52, the motion vector information b is inputted 

25 into a motion compensation predictor 57 and the encode mode 
information c controls switching means 59 to be described 
later. 
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The quantization discrete cosine transform 
coefficients a inputted into the inverse quantizer 52 are 
dequantized and discrete cosine transform coefficients F(u, 
v) are outputted. The discrete cosine transform 
5 coefficients F(u, v) are inputted into a scaling unit 53, 
which unit scales coefficient data. To conduct scaling, 
each discrete cosine transform coefficient is changed 
according to a formula given as a formula (15) in Fig. 23. 
In the formula, F(u, v) and F ' (u, v) are discrete cosine 
10 transform coefficients inputted into the scaling unit 53 
and discrete cosine transform coefficients which have been 
scaled, respectively. Also, M X n (where N is a positive 
even umber) is the base size of encoding-side discrete cosine 
transform, u and v are coordinates of the discrete cosine 
15 transform coefficients in horizontal and vertical 
directions, respectively, where u = 0, 1, , (N/2 pl -l) and 
v = 0, 1, (N/2 p2 -l), respectively. Symbols pi and p2 

are parameters (integers) for determining the base size of 
the small-base inverse discrete cosine transform in 
20 horizontal and vertical directions , respectively , where the 
base size is N/2 pl and N/2 p2 in horizontal and vertical 
directions, respectively. For example, at pi = p2 = 1, base 
size is N/2 X n/2. 

Further, for simplifying the process , scaling as shown 
25 in the following formula (16) can be utilized: 

F'(u, v) = F(u, v) / {(2 pl/2 ) X (2 p2/2 )} (16) 

The discrete cosine transform coefficients F'(u, v) 
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subjected to scaling are inputted into a small-base inverse 
discrete cosine transformer 54. In the small-base inverse 
discrete cosine transformer 54 , the discrete cosine 
transform coefficients F' (u, v) are inversely transformed 
5 by inverse discrete cosine transform of a smaller base of 
basesizeN/2 pl andN/2 p2 in horizontal and vertical directions, 
respectively, than that of the conventional transform, and 
pictures f'(if j) are outputted. 

The pictures f ■ (i, j) are inputted into a resolution 

10 converter 55 in which the resolution of the picture is 
converted into a spatial resolution of a picture in same 
size at the encoding side and outputted as f(x, y). To 
convert spatial resolution from resolution of f'(i, j) to 
that of f(x, y), an interpolation method or a simple 

15 interpolation method can be utilized. 

At pi = p2 = 1, for example, the following conversion 
can be made according to the interpolation method as shown 
in formulas (17) to (20): 

f (x, y) = f (2i, 2j) = f • (i, j) -(17) 

20 f(x, y) = f(2i+l, 2j) = (f'(i, j) + f(i+l, j)) / 2 

•••(18) 

f(x, y) = f(2i, 2j+l) = (f'(i/ j) + f'(i# j+1)) / 2 
•••(19) 

f (x, y) = f (2i+l, 2j+l) = (f ' (i, j) + f 1 (i+1, j) + f 1 (i, 
25 j+1) + f'(i+l, j + 1)) / 4 ---(20) 

where x, y = 0, 1, 2, ••-, N-l. 

In addition, the following conversion can be made 
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according to the simple interpolation method as shown in 
formulas (21) to (24): 

f (x, y) = f <2i, 2j) = f ' (i, j) -(21) 
f(x, y) = f(2i+l, 2j) = f'(i, j) -(22) 
5 f(x, y) = f(2i, 2j+l) = f'(i, j) -(23) 

f(x, y) = f(2i+l, 2j+l) = f'(i, j) -(24) 
Meanwhile, the motion vector information b decoded by 
the variable length decoder 51 is inputted into the motion 
compensation predictor 57. The motion compensation 
10 predictor 57 loads corresponding picture information from 
the frame memory 58 in accordance with the inputted motion 
vector information b and outputs a motion compensation 
predictive picture c(x, y). 

Further, the encode mode information c decoded by the 
15 variable length decoder 51 controls the switching means 59 . 
If the encode mode is an intra-plane encode mode, the 
switching means 59 is turned off, nothing is added to the 
outputs f (x, y) from the resolution converter 55 by an adder 
56, and the outputs r(x, y) are outputted as they are and 
20 stored in the frame memory 58 at the same time. 

Meanwhile, if the encode mode is a mode other than the 
intra-plane encode mode, the switching means 59 is turned 
on, and the motion compensation predictive picture c(x, y) 
is added to the outputs f (x, y) from the resolution converter 
25 55 by the adder 56 and the results are outputted as decoded 
picture outputs r(x, y) and stored in the frame memory 58 
at the same time. 
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As stated above, according to this embodiment, the 
small-base inverse discrete cosine transformer 54 performs 
inverse discrete cosine transform using the base size of 
N/2 pl and N/2 p2 in horizontal and vertical directions, 
5 respectively, scaled by the scaling unit 53. Thus, it is 
possible to greatly improve a processing speed compared with 
the conventional speed. 

Next, the sixth embodiment of the present invention 
will be described with reference to Fig* 14. In this 
10 embodiment, data is decoded using a low-pass filter 
processing and a non-zero coefficient inverse discrete 
cosine transform processing. 

Compressed video data is first inputted into a variable 
length decoder 51. Since the operation of the variable 
15 length decoder 51 and that of an inverse quantizer 52 are 
the same as or equivalent to those in the preceding fifth 
embodiment , no description will be given thereto . Discrete 
cosine transform coefficients F(u, v) outputted from the 
inverse quantizer 52 are inputted into a low-pass filter 
20 61, which filter filters coefficient data. 

Filtering can be realized by leaving only low range 
coefficients among the discrete cosine transform 
coefficients F(u, v) of N X N in size. If it is assumed 
that coefficients which have been subjected to low-pass 
25 filtering are F 1 (u, v) , it is possible to utilize filtering 
as shown in the following formulas (25) and (26): 

At 0 ^ u ^ bl and 0 ^ v ^ b2 , F' (u, v) = F(u, v) — 
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(25) 

At u > bl or v > b2, F'(u, v) = 0 — (26) 
In the formulas, u, v = 0, 1, 2, N-l. Symbols bl 
and b2 are filtering parameters which are integers equal 
5 to or lower than N. 

Also, it is possible to use the following formulas (27) 
and (28) to carry out filtering: 
At b2 u + bl v S bl b2, 

F 1 (u, v) = F(u, v) ••• (27 ) 
10 At b2 u + bl v > bl b2 , 

F' (u, v) = 0 ••• (28) 
The discrete cosine transform coefficients F'(u, v) 
which have been subjected to low-pass filtering are inputted 
into a non-zero coefficient inverse discrete cosine 
15 transformer 62 having the base of the same size as that of 
the encoding-side base. The non-zero coefficient inverse 
discrete cosine transformer 62 inversely transforms the 
discrete cosine transform coefficients F 1 (u, v) and outputs 
pictures f(x, y) . Here, x, y = 0, 1/ 2, , N-l. 
20 Further, the base of the non-zero coefficient inverse 

discrete cosine transformer 62 has the same size N X n as 
that of the encoding-side discrete cosine transform and the 
transformer 62 performs inverse discrete cosine transform 
according to formulas (29) and (30) shown in Fig. 23 while 
25 using coefficients not more than bl and b2 for u and v, 
respectively. While the base of the non-zero coefficient 
inverse discrete cosine transformer 62 has the same size 



-35- 



as that of the encoding-side base, a large quantity of F 1 (u, 
v) = 0 data exist as a result of the filtering conducted 
by the low-pass filter 61 . Due to this , the processing speed 
of the non-zero coefficient inverse discrete cosine 
5 transformer 62 greatly improves. 

Instead of the inverse discrete cosine transform using 
the above-stated formulas (29) and (30) , butterfly operation 
may be used. Fig. 15 shows one example of high-speed inverse 
discrete cosine transform using conventional butterfly 

10 operation, i.e., butterfly operation while the filtering 
is not conducted, and shows a high-speed inverse discrete 
cosine transform processing as described in B. G. Lee, "A 
new algorithm to compute the discrete cosine transform' 1 , 
IEEE Trans-Acoust . , Speech, and Signal Processing, vol. 

15 ASSP-32, pp. 1243-1245, Dec. 1984. Fig. 15 shows an inverse 
discrete cosine transform processing for a one-dimensional 
signal while N is 8 . It is noted that symbols in Fig. 15 
signify a formula (31) shown in Fig. 23. According to the 
processing of Fig. 15, an inverse discrete cosine transform 

20 processing is conducted to eight inputs of F'(0), F'(l), 
F' (7) and eight picture outputs of f (0) , f (1) , f (7) 
are obtained. 

However, after conducting filtering in this embodiment, 
the butterfly operation becomes what is shown in Fig. 16. 
25 Fig. 16 shows non-zero coefficient inverse discrete cosine 
transform by means of butterfly operation if a filtering 
parameter bl is 4(bl =4). In this embodiment, only the 
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four inputs of F' (0) to F' (3) are inputted and an inverse 
discrete cosine transform processing is conducted, with the 
result that eight picture data of f (0), f(l), — , f(7) are 
decoded. In this way, compared with the conventional 
5 inverse discrete cosine transform using N inputs, this 
embodiment suffices to conduct only inverse discrete cosine 
transform calculations corresponding to b points in a low 
range which are not zero, thereby greatly improving a 
processing speed. 

10 The motion vector information decoded by the variable 

length decoder 51 is inputted into a motion compensation 
predictor 57 as in the case of the fifth embodiment. The 
motion vector predictor 57 loads corresponding picture 
information from the frame memory 58 according to the 

15 inputted motion vector information and outputs a motion 
compensation predictive picture c(x, y) . 

Also, encode mode information decoded by the variable 
length decoder 51 controls switching means 59 as in the case 
of the fifth embodiment . If the encode mode is an intra-plane 

20 encode mode, the switching means 59 is turned off, nothing 
is added to outputs f (x, y) from an inverse discrete cosine 
transformer 62 by an adder 56, and the results are outputted 
as decoded picture outputs r(x, y) as they are and stored 
in a frame memory 58 at the same time. 

25 Meanwhile, if the encode mode is a mode other than the 

intra-plane encode mode, the switching means 59 is turned 
on, a motion vector predictive picture c(x, y) is added to 
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outputs f(x, y) from the non-zero coefficient inverse 
discrete cosine transformer 62 by the adder 56 and the outputs 
c ( x / y) are outputted as decoded picture outputs r(x, y) 
and stored in the frame memory 58 at the same time. 
5 As stated above , according to this embodiment, the base 

of the non-zero coefficient inverse discrete cosine 
transformer 62 is the same in size as encoding-side discrete 
cosine transform. However, since a large quantity of data 
F*(u, v) = 0 exist as a result of filtering conducted by 
10 the low-pass filter 61 , the substantial processing quantity 
of the non-zero inverse discrete cosine transformer 62 is 
greatly reduced and a processing speed thereby greatly 
improves . 

Next, the seventh embodiment will be described with 
15 reference to Fig. 17. In this embodiment, a processing speed 
in a conventional method for decoding only pictures encoded 
in an intra-plane encode mode and not decoding pictures 
encoded in modes other than the intra-plane encode mode, 
is further improved . 
20 Compressed video data is inputted into a variable length 

decoder 51. The variable length decoder 5 1 decodes an encode 
mode such as quantization discrete cosine transform 
coefficients a, encode mode information c and the like. When 
the encode mode is an intra-plane encode mode, switching 
25 means 51a is closed and the quantization discrete cosine 
transform coefficients a are outputted to an inverse 
quantizer 52 from the variable length decoder 51. The 
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quantization discrete cosine transform coefficients a 
inputted into the inverse quantizer 52 are dequantized and 
discrete cosine transform coefficients F(u, v) are outputted . 
The discrete cosine transform coefficients F(u, v) are 
5 inputted into a scaling unit 53 which scales coefficient 
data. 

With a scaling method, the respective discrete cosine 
transform coefficients are changed according to a formula 
given as the formula (15) . Further , to simplify the method, 

10 scaling as shown in the formula (16) can be utilized. 

The discrete cosine transform coefficients F" (u, v) 
which have been scaled are inputted into a small-base inverse 
discrete cosine transformer 54 . In the small-base inverse 
discrete cosine transformer 54, the discrete cosine 

15 transform coefficients F' (u, v) are inversely transformed 
by inverse discrete cosine transform with a base size of 
N/2 pl and N/2 p2 in horizontal and vertical directions, 
respectively and pictures f(i, j) are outputted. The 
pictures f 1 (i, j) are inputted into a resolution converter 

20 55, the resolution of the pictures are converted into a 
spatial resolution which is the same in size as encoding-side 
resolution and outputted as f ( x , y ) . As a spatial resolution 
converting method of converting the resolution of f'(i, j) 
into that of f (x, y) , the interpolation method or the simple 

25 interpolation method as used in the fifth embodiment can 
be used. 

The outputs f (x, y) from the resolution converter 55 
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are outputted as decoded picture outputs r(x, y) as they 
are. 

According to this embodiment, it is possible to greatly 
improve a processing speed for processing a picture encoded 
5 in an intra code mode. 

Next, the eighth embodiment of the present invention 
will be described with reference to Fig. 18 . As in the case 
of the preceding seventh embodiment, a processing speed for 
processing a picture encoded in an intra code mode in this 

10 embodiment is improved. 

Compressed video data is inputted into a variable length 
decoder 5 1 . The variable length decoder 5 1 decodes an encode 
mode such as quantization discrete cosine transform 
coefficients a, encode mode information c and the like. When 

15 the encode mode is an intra code mode, switching means 51a 
is closed and the quantization discrete cosine transform 
coefficients a are outputted from the variable length decoder 
51 to an inverse quantizer 52. The quantization discrete 
cosine transform coefficients a inputted into the inverse 

20 quantizer 52 are dequantized and discrete cosine transform 
coefficients F(u, v) are outputted. The discrete cosine 
transform coefficients F(u, v) are inputted into a low-pass 
filter 61 and coefficient data is filtered therein. 

As a filtering method, while coefficients which have 

25 been subjected to low-pass filtering are assumed as F'(u, 
v) , filtering using the formulas (25) and (26) can be utilized. 
Alternatively, filtering using the formulas (27) and (28) 
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can be utilized. By filtering the coefficients, it is 
possible to leave only coefficients in a low range among 
the discrete cosine transform coefficients F(u, v) of N X 
N in size. 

5 The discrete cosine transform coefficients F' (u, v) 

which have been subjected to low-pass filtering are inputted 
into a non-zero coefficient inverse discrete cosine 
transformer 62. The base of this non-zero coefficient 
inverse discrete cosine transformer 62 has the same size 

10 NX N as that of the encoding-side base. In the transformer 
62, inverse discrete cosine transform is performed by the 
formulas (29) and (30) with coefficients not more than bl 
and b2 used for u and v, respectively. Alternatively, as 
in the case of the sixth embodiment, the butterfly operation 

15 shown in Fig. 16 may be utilized. 

The discrete cosine transform coefficients F' (u, v) 
are inversely transformed by the non-zero coefficient 
inverse discrete cosine transformer 62 and pictures f (x, 
y) are outputted. Here, x and y satisfy x, y = 0, 1, 2, 

20 ***,N-1. The outputs f (x, y) from the inverse discrete cosine 
transformer 62 are outputted as decoded picture outputs r (x, 
y) as they are. 

According to this embodiment, as in the case of the 
seventh embodiment, it is possible to greatly improve a 

25 processing speed for processing a picture encoded in an intra 
code mode. 

Next, the ninth embodiment of the present invention 
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will be described with reference to Fig. 19. In Fig. 19, 
reference symbol 51a denotes switching means and the 
remaining reference symbols denote the same or equivalent 
constituent elements as or to those shown in Fig. 13. In 
5 this embodiment, a processing speed for decoding a picture 
which has been subjected to intra coding and one-way 
predictive encoding is improved. 

Compressed video data is inputted into a variable length 
decoder 51. The variable length decoder 51 decodes 

10 quantization discrete cosine transform coefficients a, 
motion vector information b, encode mode information c and 
the like. The encode mode information c controls the 
switching means 51a and 59. 

The encode mode information c turns on the switching 

15 means 51a when an encode mode is an intra code mode or a 
one-way predictive encode plane mode. When the encode mode 
is the intra code mode, the switch 59 is turned off. when 
the encode mode is the one-way predictive encode plane mode, 
the switch 59 is turned on. When the encode mode is a mode 

20 other than these encode modes, the switching means 51a is 
turned off. As a result, the quantization discrete cosine 
transform coefficients a are inputted into an inverse 
quantizer 52 when the encode mode is the intra code mode 
or the one-way predictive encode plane mode and decoded 

25 picture outputs r(x, y) are finally obtained by the same 
operation as that described in the fifth embodiment. 

According to this embodiment , only intra coded pictures 
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and one-way predictive encoded pictures are decoded while 
the other pictures are not decoded. It is, therefore, 
possible to not only improve a decoding speed due to this 
thinning-out operation but also improve the processing speed 
5 of a small-base inverse discrete cosine transformer 54 
described in the fifth embodiment. Thus, the improvement 
of the processing speed is superior to that in the fifth 
embodiment . 

Next, the tenth embodiment of the present invention 
10 will be described with reference to Fig. 20. In Fig. 20, 
reference symbol 51a denotes switching means and the other 
reference symbols denote the same or equivalent constituent 
elements as or to those in Fig. 13. In this embodiment, 
a processing speed for decoding a picture which has been 
15 subjected to intra coding and one-way predictive encoding 
is improved . 

Compres sed video data is inputted into a variable length 
decoder 51. The variable length decoder 51 decodes 
quantization discrete cosine transform coefficients a, 

20 motion vector information b, encode mode information c and 
the like. The encode mode information c controls the 
operation of the switching means 51a and 59. 

The encode mode information c turns on the switching 
means 51a when an encode mode is an intra code mode or a 

25 one-way predictive encode plane mode. In the intra code 
mode, the switch 5 9 is turned of f and in the one-way predictive 
encode plane mode, the switch 59 is turned on. Further, 
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in modes other than these encode modes , the switching means 
51a is turned off. As a result , when the encode mode is 
the intra code mode or the one-way predictive encode picture 
mode, the quantization discrete cosine transform 
5 coefficients a are inputted into an inverse quantizer 52 
and decoded picture outputs r(x, y) are finally obtained 
by the same operation as that described in the sixth 
embodiment. 

According to this embodiment, as in the case of the 

10 ninth embodiment, it is possible to improve a decoding speed 
for decoding a picture which has been subjected to intra 
coding and one-way predictive encoding. 

Next, the eleventh embodiment of the present invention 
will be described with reference to Fig. 21. In Fig. 21, 

15 reference symbol 70 denotes an inverse discrete cosine 
transformer, reference symbols 71 and 72 denote switches 
and the remaining reference symbols denote the same or 
equivalent constituent elements as or to those in Fig. 13, 
respectively. In this embodiment, an intra coded picture 

20 forms a basis for decoding of pictures encoded in other modes . 
Due to this, the intra coded picture is decoded in a complete 
fashion to thereby improve a decoding speed for decoding 
a picture encoded in a mode other than the intra code mode. 
Compressed video data is inputted into a variable length 

25 decoder 51. The variable length decoder 51 decodes 
quantization discrete cosine transform coefficients a, 
motion vector information b, encode mode information c and 
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the like. 

The quantization discrete cosine transform 
coefficients a are inputted into an inverse quantizer 52 
and the motion vector information is inputted into a motion 
5 compensation predictor 57. The quantization discrete 
cosine transform coefficients a inputted into the inverse 
quantizer 52 are dequantized and discrete cosine transform 
coefficients F(u, v) are outputted. 

When an encode mode is an intra code mode, the switch 

10 71 is connected to a terminal si, the switch 72 is connected 
to a terminal s3, the switch 59 is turned off and the 
quantization discrete cosine transform coefficients a are 
inputted into an inverse discrete cosine transformer 70. 
The inverse discrete cosine transformer 70 performs inverse 

15 discrete cosine transform by the same base size N X n as 
that of the encoding-side base and outputs f(x, y) , which 
are outputted as decoded picture outputs r(x, y) as they 
are and also stored in a frame memory 58. 

Meanwhile, when the encode mode is a mode other than 

20 the intra code mode, the switch 71 is connected to a terminal 
s2, the switch 72 is connected to a terminal s4, the switch 
59 is turned on, and the discrete cosine transform 
coefficients are inputted into a scaling unit 53 which scales 
coefficient data. Discrete cosine transform coefficients 

25 F' (u, v) which have been subjected to scaling are inputted 
into a small-base inverse discrete cosine transformer 54, 
the outputs of which are inputted into a resolution converter 
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55. Since the operations of the scaling unit 53, the 
small-base inverse discrete cosine transformer 54 , the 
resolution converter 55 and the remaining constituent 
elements are the same as those in the fifth embodiment, 
5 description will not be given thereto. 

According to this embodiment, it is possible to 
simultaneously realize the improvement of the picture 
quality of a decoded picture and the improvement of a decoding 
processing speed. 

10 Next, the twelfth embodiment of the present invention 

will be described with reference to Fig. 22. In Fig. 22, 
reference symbol 80 denotes an inverse discrete cosine 
transformer, reference symbols 81 and 82 denote switches 
and the remaining reference symbols denotes the same or 

15 equivalent constituent elements as or to those shown in Fig. 
14, respectively. In this embodiment, as in the case of 
the eleventh embodiment, the intra coded picture is decoded 
in a complete fashion and a decoding speed for decoding a 
picture encoded in the other mode is improved. 

20 In this embodiment, when an encode mode is an intra 

code mode, the switch 81 is connected to a terminal si, the 
switch 82 is connected to a terminal s3, the switch 59 is 
turned off and quantization discrete cosine transform 
coefficients a are inputted into an inverse discrete cosine 

25 transformer 80. The inverse discrete cosine transformer 
80 performs inverse discrete cosine transform by the same 
base size N X n as that at the encoding-side base and outputs 
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f ( x / y) / which are outputted as decoded picture outputs r (x, 
y) as they are and also stored in a frame memory 58. 

Meanwhile, when the encode mode is a mode other than 
the intra code mode, the switch 81 is connected to a terminal 
5 s2, the switch 82 is connected to a terminal s4, the switch 
59 is turned on, and the discrete cosine transform 
coefficients F(u, v) are inputted into a low-pass filter 
61 which filters coefficient data. The filtered data is 
then inputted into a non-zero coefficient inverse discrete 

10 cosine transformer 62 . Since the operations of the low-pass 
filter 61, the non-zero coefficient inverse discrete cosine 
transformer 62 and the remaining constituent elements are 
the same as those in the sixth embodiment, description will 
not be given thereto. 

15 According to this embodiment, as in the case of the 

eleventh embodiment, it is possible to simultaneously 
realize the improvement of the picture quality of a decoded 
picture and the improvement of a decoding processing speed. 
Next, the functions of the decoding apparatus in 

20 above-stated embodiments can be realized by software 
(program) , which software can be recorded on a portable type 
recording medium such as an optical disk, a floppy disk or 
a hard disk. 

Fig. 24 shows one example of a program stored on the 
25 storage medium. Fig. 24A shows the contents of the storage 
medium executing the functions of the decoding apparatus 
in the embodiment in Fig. 13, whereas Fig. 24B shows the 
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contents of the storage medium executing the functions of 
the decoding apparatus in the embodiment in Fig. 14. 

A storage medium 200 shown in Fig. 24A stores thereon 
a decoding program of a variable length decoding function 
5 111 , an inverse quantization function 121 , a scaling function 
13 1 , a small-base inverse discrete cosine transform function 
141 , a resolution conversion function 151 , an addition 
function 161 and a motion compensation prediction function 
171. 

10 A storage medium 200 shown in Fig. 24B stores thereon 

a decoding program of a variable length decoding function 
111, an inverse quantization function 121 , a low-pass filter 
function 2 1 1 , a non-zero coefficient inverse discrete cosine 
conversion function 221, an addition function 161 and a 

15 motion compensation prediction function 171. It is noted 
that functions recorded on the recording medium may not be 
all the functions described above but only important 
functions among them. 

Fig. 12 is a block diagram showing the hardware 

20 configuration of a computer which reads the decoding program 
recorded on the portable type storage medium and executes 
the decoding function. The computer 100 consists of a 
storage medium 200 on which the above-stated decoded program 
is recorded, a reader 105 reading the decoding program from 

25 the storage medium 200, a CPU 101 executing the decoding 
program, an ROM 103 storing various data, an RAM 104 storing 
operation parameters and the like, an input device 102 such 
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as a keyboard or a mouse, an output device 102 such as a 
display or a printer, and a bus 106 connecting the respective 
constituent elements of the computer 100. 

The CPU 101 reads the decoding processing program 
5 recorded on the storage medium 200 through the reader 105 
and then executes the decoding processing program, thereby 
executing the above-stated decoding processing. As a frame 
memory 58 used to execute the decoding processing program, 
part of the region of the RAM 104 or part of the region of 
10 a hard disk which is not shown in Fig. 12 can be utilized. 
It is noted that the storage medium 200 also includes a 
transmission medium for temporarily recording and storing 
data such as a network. 

Further, the compressed video data thus decoded may 
15 be stored in a memory such as the hard disk in advance or 
captured into the computer 100 from a network which is not 
shown in Fig. 12. 

As is obvious from the above-stated description, the 
apparatus, the method and the storage medium according to 
20 the present invention can obtain the following advantages : 
(1) It is possible to efficiently transmit picture 
information while suppressing the generation of packet loss 
by smoothing packet transmission without the need to employ 
FIFO requiring overflow and underflow control and without 
25 the need to start another process for network output. 

(2) In case of multi-channel transmission, it is 
possible to transmit only filtered picture information even 
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if a network band in the middle of transmission is narrower. 

(3) Even if a transmission network band constantly or 
temporarily exceeds a stream band to make it difficult to 
compression-transmit live picture information, it is 
possible to compress ion- transmit live information from 
information fed back to the encoder by reducing an encoding 
bit rate. 

(4) It is possible to compression-transmit picture 
information on a plurality of channels efficiently in a real 
time manner by smoothing packet transmission for each channel 
and by conducting transmission timing control so as to 
minimize the sum of packet loss rates of the channels. 

(5) Since decoding processing is conducted using an 
inverse discrete cosine transform of small-base size, the 
low-pass filter of discrete cosine transform coefficients 
and non-zero coefficient inverse discrete cosine transform, 
it is possible to decode a compressed video data at higher 
speed than the conventional speed. Besides, it is possible 
to provide a storage medium storing program allowing 
high-speed compressed video data decoding processing. 
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WHAT IS CLAIMED IS: 

1 . A real-time picture information 
compression-transmission apparatus for 
compress ion- transmitting picture information in a real time 

5 manner, comprising: 

input means for receiving said picture information; 
an encoder encoding said picture information from the 
input means on a preset cycle in a real time manner; 

storage means for writing and storing 
10 real-time-encoded frame data on said picture information 
from the encoder for each frame; 

division means for sequentially dividing said 
real-time-encoded frame data stored in the storage means 
into packets for each frame; and 
15 transmission timing control and transmission means for 

controlling transmission timing to sequentially transmit 
the divided packets to a network after a write time for storing 
said frame data for the packets and before a time for storing 
next frame data, and for transmitting the packets to the 
20 network according to a connection-less type protocol, 

2 . A real-time picture information 
compression-transmission apparatus according to claim 1, 

25 wherein 

the division means for dividing each frame data into 
the packets, divides each of said encoded frame data into 
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the packets in size suited for an Ethernet maximum transfer 
unit; and 

the transmission timing for transmitting the divided 
packets to the network is determined from an encoded frame 
5 interval and a frame data storage time. 



3. A real-time picture information 

compression-transmission apparatus according to claim 1, 
10 wherein 

the division means for dividing each frame data into 
the packets is constituted so that: 

a payload size of a transmitted UDP packet corresponds 
to a value obtained by subtracting an IP header size and 
15 a UDP header size from an Ethernet maximum transfer unit; 
and 

the number of UDP packets divided from a K-th frame 
corresponds to a value obtained by dividing a data size, 
in bytes, of the K-th frame by the payload size, in bytes, 

20 of the transmitted UDP packet; and 

the transmission timing, controlled by said control 
means, for transmitting the packets to the network is set 
so that a transmission time, in seconds, for transmitting 
the K-th frame data to the network corresponds to a value 

25 obtained by subtracting a write time, in seconds, for which 
said encoder writes the K-th frame data into said storage 
means, from a frame interval, in seconds, between the K-th 
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frame data and a (K + l)th frame data* 

4. A real-time picture information 

5 compression-transmission apparatus according to claim 1, 
wherein 

if multi-channel transmission is conducted, the 
transmitted packets are further filtered using one of UDP 
port numbers and IP multi-cast addresses, whereby even if 
10 a network band in which the packets are being transmitted 
is narrowed, filtered picture information can be 
transmitted . 

15 5. A real-time picture information 

compression-transmission apparatus according to claim 2, 
wherein 

if multi-channel transmission is conducted, the 
transmitted packets are further filtered using one of UDP 
20 port numbers and IP multi-cast addresses, whereby even if 
a network band in which the packets are being transmitted 
is narrowed, filtered picture information can be 
transmitted* 

25 

6. A real-time picture information 

compression-transmission apparatus according to claim 3, 
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wherein 

if multi-channel transmission is conducted, the 
transmitted packets are further filtered using one of UDP 
port numbers and IP multi-cast addresses, whereby even if 
5 a network band in which the packets are being transmitted 
is narrowed, filtered picture information can be 
transmitted. 



10 7. A real-time picture information 

compression-transmission apparatus for 

compression-transmitting live picture information in a real 
time manner, comprising: 

input means for receiving said live picture 
15 information; 

an encoder encoding said live picture information from 
the input means on a preset cycle in a real time manner; 

storage means for writing and storing 
real-time-encoded frame data on said picture information 
20 from the encoder for each frame; 

division means for sequentially dividing said 
real-time-encoded frame data stored in the storage means 
into packets for each frame; 

transmission timing control and transmission means for 
25 controlling transmission timing to sequentially transmit 
the divided packets to a network after a write time for storing 
said frame data for the packets and before a time for storing 



-54- 



next frame data, and for transmitting the packets to the 
network according to a connection-less type protocol; 

packet loss detection means for detecting packet loss 
of the packets transmitted to the network; and 
5 encoding bit rate control means for controlling an 

encoding bit rate of said encoder by the detected packet 
loss . 

10 8 . A real-time picture information 

compression-transmission apparatus according to claim 7, 
wherein 

the packet loss detection means detects said packet 
loss by searching an order of serial numbers in the packets ; 
15 the encoding bit rate control means controls said 

encoder to reduce said encoding bit rate if a packet loss 
value exceeds a threshold. 

20 9. A real-time picture information 

compression-transmission apparatus according to claim 7 , 
wherein 

each of the serial numbers in said packets is inserted 
after a packet header and into a top of user packet data. 

25 

10. A real-time picture information 
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compression-transmission apparatus for 

compression-transmitting picture information on a 
plurality of channels in a real time manner, comprising: 

a plurality of sets of input means for receiving said 
5 picture information; 

a plurality of sets of encoders encoding said picture 
information from the input means on a preset cycle in a real 
time manner; 

a plurality of sets of storage means for writing and 

10 storing real-time encoded frame data on said picture 
information from the encoder for each frame; 

a plurality of sets of division means for sequentially 
dividing said real-time encoded frame data stored in the 
storage means into packets for each frame; 

15 a plurality of sets of transmission timing control and 

transmission means for controlling transmission timing to 
sequentially transmit the divided packets to a network after 
a write time for storing said frame data for the packets 
and before a time for storing next frame data, and for 

20 transmitting the packets to the network according to a 
connection-less type protocol, wherein 

the plurality of sets of input means f encoders , storage 
means, division means and transmission timing control and 
transmission means are prepared to correspond to the picture 

25 information on the plurality of channels, respectively, so 
as to process live picture information on said plurality 
of channels; 
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packet loss detection means for detecting packet loss 
of the packets transmitted to the network; and 

transmission timing control and adjustment means for 
adjusting and controlling said transmission timing 
5 controlled and transmitted by said plurality of sets of 
transmission timing control and transmission means , 
respectively . 



10 11- A real-time picture information 

compression-transmission apparatus according to claim 10, 
wherein 

the adjustment and control of said transmission timing 
is carried out so as to minimize a sum of packet loss rates 
15 of the respective channels. 



12. A real-time picture information 

compression-transmission apparatus according to claim 10, 
20 wherein 

the adjustment and control of said transmission timing 
is carried out by setting same or different packet 
transmission start offset for each channel, the packet 
transmission start offset conducted to be changed in frame 
25 units . 
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13, A real-time picture information 

compression-transmission apparatus according to claim 11, 
wherein 

the adjustment and control of said transmission timing 
5 is carried out so that a J channel packet transmission delay 
corresponds to a value obtained by dividing an eightfold 
value of a product between the Ethernet maximum transfer 
unit and a J channel timing fine adjustment parameter SJ, 
where 1 S J ^ N, and N is the number of channels, by an 

10 effective network band in bit /sec , and so that an upper limit 
of packet transmission timing fine adjustment parameters 
SJ, where SJ includes SI, S2, S3, SN, N is total channel 
number, and 1 ^ J ^ N, corresponds to a value obtained by 
dividing an average packet transmission interval per channel 

15 by a time required to transmit the Ethernet maximum transfer 
unit . 



14. A real-time picture information 

20 compression-transmission method for 

compression-transmitting picture information in a real time 
manner , compr is ing : 

an encoding step of encoding said picture information 
on a preset cycle in a real time manner; 
25 a storage step of writ ing and storing real-time-encoded 

frame data on said picture information for each frame; 

a division step of sequentially dividing said 
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real-time-encoded frame data into packets for each frame; 
and 

a transmission timing control and transmission step 
of controlling transmission timing to sequentially transmit 
5 the divided packets to a network after a write time for storing 
said frame data for the packets and before a time for storing 
next frame data, and of transmitting the packets to the 
network according to a connection-less type protocol. 

10 

15. A real-time picture information 

compression-transmission method for 

compression-transmitting live picture information in a real 
time manner, comprising: 
15 an encoding step of encoding said live picture 

information on a preset cycle in a real time manner; 

a storage step of writing and storing real-time-encoded 
frame data on said picture information for each frame; 

a division step of sequentially dividing said 
20 real-time-encoded frame data into packets for each frame; 

a transmission timing control and transmission step 
of controlling transmission timing to sequentially transmit 
the divided packets to a network after a write time for storing 
said frame data for the packets and before a time for storing 
25 next frame data, and of transmitting the packets to the 
network according to a connection-less type protocol; 

a packet loss detection step of detecting packet loss 



-59- 



of the packets transmitted to the network; and 

an encoding bit rate control step of controlling an 
encoding bit rate in said encoding step by the detected packet 
loss . 



16. A real-time picture information 

compression-transmission method for 

compression-transmitting picture information on a 
10 plurality of channels in a real time manner, comprising: 
an encoding step of encoding said picture information 
on a preset cycle in a real time manner; 

a storage step of writing and storing real-time encoded 
frame data on said picture information for each frame; 
15 a division step of sequentially dividing said real-time 

encoded frame data into packets for each frame; 

a transmission timing control and transmission step 
of controlling transmission timing to sequentially transmit 
the divided packets to a network after a write time for storing 
20 said frame data for the packets and before a time for storing 
next frame data, and of transmitting the packets to the 
network according to a connection-less type protocol; 

a packet loss detection step of detecting packet loss 
of the packets transmitted to the network; and 
25 a transmission timing control and adjustment step of 

adjusting and controlling said transmission timing in said 
transmission timing control and transmission step for said 
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each channel by the detected packet loss. 

17. A storage medium stored a control program for 
5 allowing a computer to control compression-transmitting 

picture information in a real time manner, the control 
program allowing the computer to control: 

encoding said picture information on a preset cycle 
in a real time manner; 
10 writing and storing real-time-encoded frame data on 

said picture information for each frame; 

sequentially dividing said real-time-encoded frame 
data into packets for each frame; and 

controlling transmission timing to sequentially 
15 transmit the divided packets to a network after a write time 
for storing said frame data for the packets and before a 
time for storing next frame data, and transmitting the 
packets to the network according to a connection-less type 
protocol . 

20 

18. A storage medium stored a control program for 
allowing a computer to control compression-transmitting 
live picture information in a real time manner, the control 

25 program allowing the computer to control: 

encoding said live picture information on a preset cycle 
in a real time manner; 
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writing and storing real-time-encoded frame data on 
said picture information for each frame; 

sequentially dividing said real-time-encoded frame 
data into packets for each frame; 
5 controlling transmission timing to sequentially 

transmit the divided packets to a network after a write time 
for storing said frame data for the packets and before a 
time for storing next frame data, and transmitting the 
packets to the network according to a connection-less type 
10 protocol; 

detecting packet loss of the packets transmitted to 
the network; and 

controlling an encoding bit rate in said encoding by 
the detected packet loss. 

15 

19. A storage medium stored a control program for 
allowing a computer to control compression-transmitting 
live picture information on a plurality of channels in a 
20 real time manner, the control program allowing the computer 
to control, with respect to the live picture information 
on the plurality of channels, for each channel: 

encoding said picture information on a preset cycle 
in a real time manner; 
25 writing and storing real-time encoded frame data on 

said picture information for each frame; 

sequentially dividing said real-time encoded frame 
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data into packets for each frame; 

controlling transmission timing to sequentially 
transmit the divided packets to a network after a write time 
for storing said frame data for the packets and before a 
5 time for storing next frame data, and transmitting the 
packets to the network according to a connection-less type 
protocol; 

detecting packet loss of the packets transmitted to 
the network; and 
10 adjusting control of said transmission timing for said 

each channel by the detected packet loss. 



20. A picture information decoding apparatus for 
15 decoding compressed video data using motion compensation 
prediction and discrete cosine transform, comprising: 

means for converting an inversely-quantized discrete 
cosine transform coefficient into a smaller base than an 
encoding-side discrete cosine transform base; 
20 means for performing inverse transform using inverse 

discrete cosine transform using the smaller base than the 
encoding-side discrete cosine transform base; and 

means for converting picture data subjected to the 
inverse discrete cosine transform into picture data having 
25 a same size as a size of the compressed video data. 
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21. A picture information decoding apparatus 
according to claim 20, wherein 

the picture information decoding apparatus decodes 
only intra coded pictures. 

5 

22. A picture information decoding apparatus 
according to claim 20 , further comprising: 

means for conducting motion compensation prediction 
10 to block data having a same size as a size of encoded block 
data , and for restoring picture block data inversely discrete 
cosine transformed to have the same block size as the size 
of said encoded block data, into the video data; and 

means for storing the restored video data for said 
15 motion compensation prediction. 

23. A picture information decoding apparatus 
according to claim 22, wherein 

20 the picture information decoding apparatus decodes 

only intra coded pictures and one-way predictive encoded 
pictures . 

25 24. A picture information decoding apparatus 

according to claim 22, wherein 

the picture information decoding apparatus further 
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comprises means, connected to means for performing inverse 
trans form using inverse discrete cosine trans form using the 
smaller base than said encoding-side discrete cosine 
transform base through switching means, for conducting 
inverse discrete cosine transform with a same block size 
as a block size of said compressed video data; 

the intra coded pictures are decoded by the means for 
conducting inverse discrete cosine transform to the block 
data of the same block size as the size of said encoded block 
data; and 

encoded pictures other than the intra coded pictures 
are subjected to an inverse transform processing using the 
inverse discrete cosine transform having the smaller base 
than the encoding-side discrete cosine transform base, and 
decoded by conducting said motion compensation prediction. 

25. A picture information decoding apparatus 
according to claim 20, wherein 

said means for converting said inversely-quantized 
discrete cosine transform coefficient into the smaller base 
than the encoding-side discrete cosine transform base is 
scaling means. 

26. A picture information decoding apparatus for 
decoding compressed video data using motion compensation 
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prediction and discrete cosine transform, comprising: 

means for low-pass filtering an inversely quantized 
discrete cosine transform coefficient; and 

means for inversely transforming the low-pass filtered 
5 data using an inverse discrete cosine transform having a 
base of a same size as a size of an encoding-side discrete 
cosine transform base, wherein 

the inverse discrete cosine transform is to inversely 
transform a non-zero discrete cosine transform coefficient . 

10 

27. A picture information decoding apparatus 
according to claim 26, wherein 

the picture information decoding apparatus decodes 
15 only intra coded pictures. 

28. A picture information decoding apparatus 
according to claim 27, further comprising: 

20 means for conducting motion compensation prediction 

to block data having a same size as a size of encoded block 
data, and for restoring the video data; and 

means for storing the restored video data for said 
motion compensation prediction. 

25 

29. A picture information decoding apparatus 
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according to claim 28, wherein 

the picture information decoding apparatus decodes 
only intra coded pictures and one-way predictive encoded 
pictures . 

5 

30. A picture information decoding apparatus 
according to claim 28, wherein 

the picture information decoding apparatus further 
10 comprises means , connected to means for inversely transform 
said low-pass filtered data using inverse discrete cosine 
transform having a base of a same size as a size of an 
encoding-side discrete cosine transform base through 
switching means, for conducting discrete cosine transform 
15 to the data of a same block size as a block size of the 
compressed video data; 

the intra coded pictures are decoded by the means for 
conducting discrete cosine transform to the data of the same 
block size as the block size of said compressed video data; 
20 and 

encoded pictures other than the intra coded pictures 
are decoded by inversely transforming said low-pass filtered 
data using the inverse discrete cosine transform having the 
base of the same size as the size of the encoding-side discrete 
25 cosine transform base, and by conducting said motion 
compensation prediction. 
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31. A computer readable storage medium stored a 
program for allowing a computer to execute: 

a step of converting an inversely-quantized discrete 
5 cosine transform coefficient into a smaller base than an 
encoding-side discrete cosine transform base; 

a step of performing inverse transform using inverse 
discrete cosine transform having the smaller base than the 
encoding-side discrete cosine transform base; and 
10 a step of converting picture data subjected to the 

inverse discrete cosine transform into picture data having 
a same size as a size of the compressed video data. 

15 32. A computer readable storage medium stored a 

program for allowing a computer to execute: 

a step of low-pass filtering an inversely-quantized 
discrete cosine transform coefficient; and 

a step of inversely transforming the low-pass filtered 
20 data using a base of a same size as a size of an encoding-side 
discrete cosine transform base. 

33. A computer readable storage medium according to 
25 claim 31, wherein 

the storage medium further stores a program for a step 
of conducting motion compensation prediction to block data 
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having a same size as a size of encoded block data, and of 
restoring a video data. 
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ABSTRACT OF THE DISCLOSURE 
The present invention provides a real-time live picture 
information compression-transmission apparatus and method 
us ing a connection-less type protocol for a computer network * 
The compression-transmission apparatus is constituted to 
divide frame data output from a real-time encoder compressing 
live picture information into packets, and to transmit the 
live picture information in a real time manner according 
to the connection-less type protocol while suppressing burst 
transmission by conducting transmission control* The 
present invention also provides a compressed video data 
decoding apparatus capable of reducing compressed video 
decoding processing load without deteriorating picture 
quality and decreasing the number of played back picture 
planes when playing back a picture. 
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